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ABSTRACT 

Objective: To identify case definitions for chronic 
fatigue syndrome/myalgic encephalomyelitis (CFS/ME), 
and explore how the validity of case definitions can be 
evaluated in the absence of a reference standard. 
Design: Systematic review. 
Setting: International. 

Participants: A literature search, updated as of 
November 2013, led to the identification of 20 case 
definitions and inclusion of 38 validation studies. 
Primary and secondary outcome measure: 

Validation studies were assessed for risk of bias and 
categorised according to three validation models: 
(1) independent application of several case definitions 
on the same population, (2) sequential application of 
different case definitions on patients diagnosed 
with CFS/ME with one set of diagnostic criteria or 
(3) comparison of prevalence estimates from different 
case definitions applied on different populations. 
Results: A total of 38 studies contributed data of 
sufficient quality and consistency for evaluation of 
validity, with CDC-1994/Fukuda as the most frequently 
applied case definition. No study rigorously assessed 
the reproducibility or feasibility of case definitions. 
Validation studies were small with methodological 
weaknesses and inconsistent results. No empirical data 
indicated that any case definition specifically identified 
patients with a neuroimmunological condition. 
Conclusions: Classification of patients according to 
severity and symptom patterns, aiming to predict 
prognosis or effectiveness of therapy, seems useful. 
Development of further case definitions of CFS/ME 
should be given a low priority. Consistency in research 
can be achieved by applying diagnostic criteria that 
have been subjected to systematic evaluation. 
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INTRODUCTION 

Chronic fatigue syndrome (CFS) is a serious 
disorder characterised by persistent postexer- 
tional fatigue and substantial symptoms 
related to cognitive, immune and autono- 
mous dysfunction. 1 2 Disease mechanisms 
are complex, 3 with no single causal factor 
identified. Yet there are indications that 



Strengths and limitations of this study 



The main strength of our study is the systematic 
methods used to identify and appraise articles pre 
senting and evaluating case definitions of chronic 
fatigue syndrome/myalgic encephalomyelitis. 
We used systematic and transparent approaches 
to extract data, categorise the studies according 
to prespecified models and to analyse and 
compare the data. 

The included validation studies showed consider- 
able methodological weaknesses and inconsist- 
ent results, and it is therefore difficult to draw 
firm conclusions. 



infections 4-8 and immunological dysfunc- 
tion 9 contribute to development and main- 
tenance of symptoms, probably interacting 
with genetic 10 and psychosocial 11-13 factors. 

Studies have identified pathological pat- 
terns and structures of the central nervous 
system, 14 15 dysregulation of body tempera- 
ture and blood pressure 16 17 and dysfunc- 
tional stress hormonal systems 18 19 in patients 
with CFS compared with normal controls. 
None of these appears sufficiently consistent 
to constitute a diagnostic test, and case defi- 
nitions (diagnostic criteria) are therefore 
used to define the CFS diagnosis. When case 
definitions are developed, the context of 
application must be considered, since differ- 
ent properties are needed for case definition 
intended for research purposes compared 
with case definitions used to diagnose indi- 
vidual patients. It is also necessary to con- 
sider whether a broad (ie, sensitive criteria 
ensuring that we do not miss relevant cases) 
or narrow (ie, specific criteria ensuring that 
all positive cases are definite) approach is 
most appropriate. 

Holmes et afi° coined the term 'chronic 
fatigue syndrome' in 1988, as an alternative to 
'The chronic Epstein-Barr virus syndrome'. 
Since this case definition — the CDC-1988/ 
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Holmes Criteria — was presented in 1988, numerous 
revisions have been developed, aiming for distinctive and 
reliable identification of individuals who represent a 
homogenous and consistent phenotype of the hypothe- 
sised disease entity, consistent with pathophysiological 
and psychosocial findings. Currently, the term 'myalgic 
encephalomyelitis' (ME) is commonly used to conceptu- 
alise a specific neuroimmunological condition, assumed 
to be more severe and less psychologically attributed than 
CFS. 21 In 2003, Carruthers et al presented the 
Canadian-2003 Criteria for diagnosis of ME/CFS. 22 A 
revised version was presented as International Consensus 
Criteria (the ICC-2011 Criteria) for ME, 23 claiming to be 
a selective case definition for identification of patients 
with neuroimmune exhaustion with a pathologically low 
threshold of fatigability and symptom flare after exertion. 
The assertion that CFS and ME are different clinical 
entities is disputed. Below, we will pragmatically apply the 
termCFS/ME. 

Johnston et af 4 conducted a systematic review of the 
adoption of CFS/ME case definitions to assess the preva- 
lence and identified eight different case definitions. 
There is no general agreement on a reference standard 
for diagnosis, and no diagnostic test is available. Bossuyt 
et af h include case definitions in their understanding of 
the term 'test', emphasising that diagnostic tests are 
highly dynamic and need rigorous evaluation before 
they are introduced into clinical practice. 26 

The objectives of our study were to explore strategies 
for evaluation of accuracy and concept validity of differ- 
ent case definitions for CFS/ME in the absence of a ref- 
erence standard. First, we wanted to conduct a 
systematic review to identify and describe different case 
definitions (sets of diagnostic criteria) for CFS/ME. 
Second, we wanted to explore differences between 
various case definitions by identifying and reviewing 
validation studies. 



MATERIALS AND METHODS 
Protocol and registration 

We developed a protocol for our study. However, we did 
not publish or register it. 

Eligibility criteria 

We included studies presenting or validating case defini- 
tions for CFS/ME for adult populations (>18 years). No 
language restrictions were employed. 

Information sources and search 

We searched Ovid MEDLINE from 1946, Ovid EMBASE 
from 1980, Ovid PsycINFO from 1806, Ovid AMED from 
1985, The Cochrane Library from 1898, CINAHL from 
1981 and PEDRO from 1929, using subject headings and 
text words (see online supplementary appendix 1). All 
searches were up to date as of 25 November 2013. We 
checked the reference lists of all included articles and 



searched for unpublished and ongoing studies by corres- 
pondence with authors and field experts. 

Study selection 

To select publications eligible for this review, two authors 
independently read all titles and abstracts in the records 
retrieved by the searches. We obtained publications in 
full text if the abstract was deemed eligible by at least one 
review author. At least two authors independently read 
the full text papers and selected studies according to the 
inclusion criteria. Any disagreement between review 
authors was resolved by discussion between the two 
review authors or, if necessary, by involving all authors. 

Data collection process 

First, we listed all the identified case definitions for CFS/ 
ME. One author gathered information about citation 
from ISI and Google Scholar to indicate the impact or 
widespread of use, but we made no attempt to assess or 
rank the quality of the case definitions at this stage. 

To facilitate the validity assessment, we developed a 
framework consisting of three different models. 

Model A includes studies with independent application of 
different case definitions on the same population ( figure 1 ) . 
This model presents the interrelationship between sub- 
populations identified by different case definitions. 

Model B includes studies where patients diagnosed 
with CFS/ME with one set of diagnostic criteria are diagnosed 
sequentially with other case definitions assumed to have 
increasing specificity (figure 2). 

Model C includes surveys or cross-sectional studies esti- 
mating the prevalence of CFS/ME by applying different 
case definitions on different populations (figure 3). 
These studies do not directly compare different case 
definitions, but may be used for proxy evaluation, 
similar to the strategy applied by Johnston et al. 24 27 

Two authors reviewed all potentially relevant valida- 
tions studies, and categorised them according to model 
A, B or C. Any disagreement between review authors at 
this stage was resolved by reaching consensus in the 
author group. 

Risk of bias in individual studies 

To differentiate between studies with higher and lower 
risk of bias, we critically appraised all included validation 
studies according to check lists: Studies comparing two 
or more case definitions directly (ie, model A or B) 
were appraised according to the QUADAS criteria 28 
(patient selection, index test, reference standard, flow 
and timing). For evaluation of prevalence studies (ie, 
model C), we used an outline for assessment of external 
and internal validity (11 items) of prevalence studies. 29 

Analysis 

Participation in prevalence studies, surveys and question- 
naires vary across the included studies. Non-response is 
known to introduce bias, and methods to adjust for low 
response rates are available. 30 In studies affected by non- 
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Background population 



response, we have reported adjusted estimates whenever 
applicable. If adjusted estimates were unavailable, we 
have defined the proportion as the number of cases 
divided by the number of responders. We estimated 
95% CIs for all proportions by using the 
Clopper-Pearson exact binomial method. We used R 
software V.3.0.0 and the rmeta package for statistical 
computations and plotting. 31 32 



Thirteen of the 20 identified case definitions had 
been assessed in one or more validation 

. 1- 20 22 23 33 34 36 37 39-41 43 44 47 77 a 

studies. For seven case defi- 

nitions, no foundation for validation could be identified. 
We did not identify any study which rigorously assessed 
the reproducibility or feasibility of the different case 
definitions. 



RESULTS 
Study selection 

Our systematic literature search identified 1660 unique 
references, of which 56 articles fulfilled our inclusion 
criteria (figure 4). Twenty articles present different case 
definitions of CFS/ME for research or clinical prac- 
tice 20 22 23 33-49 (table 1). Furthermore, 38 studies were 
classified as validation studies, contributing data of suffi- 
cient quality and consistency for evaluation of different 
case definitions according to our inclusion criteria. 

The degree to which the different case definitions had 
been applied in research and clinical guidelines varied 
widely, with CDC-1994/Fukuda et at 9 as the most fre- 
quently cited case definition of CFS/ME. 






Prevalence X 


•* CFS/ME 




\ Case definition 1 y 




Background population A 







Prevalence Z 




Figure 2 Model B: evaluation design where different case 
definitions with assumed increasing specificity are applied 
sequentially on the same population (CFS, chronic fatigue 
syndrome; ME, myalgic encephalomyelitis). 



Figure 3 Model C: evaluation design with indirect 
comparisons of prevalence estimates from several case 
definitions applied on different populations (CFS, chronic 
fatigue syndrome; ME, myalgic encephalomyelitis). 



Brurberg KG, F0nhus MS, Larun L, etal. BMJ Open 2014;4:e003973. doi:1 0.1 136/bmjopen-201 3-003973 



3 



Open Access 



1660 references identified 
through search in databases 



22 references identified 
through other sources 



1682 potentially relevant articles 



1521 articles excluded 
based on titles and abstracts 



161 full-text articles 
assessed for eligibility 



105 articles did not fulfil 
selection criteria 



56 full-text articles included 



Figure 4 Flow chart summarising the selection process. 

Independent application of several case definitions on the 
same population (model A) 

Five studies (table 2) applied several case definitions on 
the same population, but only one of these reported data 
in a way that made it possible to compare the case defini- 
tions. 50 51 Nacul et af° used general practitioner (GP) 
databases and questionnaires and identified 278 patients 
with unexplained chronic fatigue (CF) conforming to one 
or more of the case definition applied, that is, CDC-1994/ 
Fukuda et al, 39 Canadian-2003 22 or ECD-2008. 34 Most of 
the patients who were positive according to the Canada 
criteria (G+) were also positive using the Fukuda criteria 
(F+) . Forty-seven per cent of the Fukuda-positive patients 
were also positive according to the Canada criteria. 
Patients who were positive to the Canada and Fukuda 
(C+/F+) reported a higher level of symptoms than 
those who were (F+/C-). The authors did not identify 
differences in the distribution of triggering factors. 50 

None of the other four studies in this group reported 
data on the correlation between case definitions, patient 
profile and symptom burden. Application of CDC-1988/ 
Holmes case definition was consistently associated with 
lower prevalence estimates than CDC-1994/Fukuda, 
Oxford-1991 and Australian- 1990 criteria across these 
four studies. There was no consistent trend for the other 
case definitions, but the studies were heterogeneous 
regarding the application of different case definitions 
and data collection (table 2). This observation suggests 
that prevalence numbers obtained by different case defi- 
nitions should be controlled according to diagnostic pro- 
cedure, cut-off points and reasons for exclusions before 
concluding on differences. 

Different case definitions with assumed increasing 
specificity applied sequentially on the same 
population (model B) 

Twelve studies (table 3) sequentially applied different 
case definitions on the same population. In these 



studies, patients were screened by using an evaluation 
standard. Subsequently, test-positive individuals were 
screened with one or more comparators. Nine of the 12 
studies applied CDC-1994/Fukuda as the evaluation 
standard, and then tested Fukuda-positive patients with 
CDC-1988/Holmes, Canadian-2003, ICC-2011, ME-2011, 
Empirical-2006/Reeves, London-1990/Dowsett or 
Neurasthenia case definitions. 

We have taken the actual evaluation standard as a 
point of departure, and calculated the proportion of 
these patients still positive when applying other case 
definitions. Since there are no test negatives for the case 
definition used as point of departure, true sensitivities 
or specificities cannot be calculated. Results from two of 
the studies by Jason et a? 3 52 suggest that 40-70% of the 
Fukuda-positive patients are also Canada positives (F+/ C+) . 
One study 52 concluded that there was less psychiatric 
comorbidity and more physical functional impairment 
in the subsample which was positive on both case defini- 
tions (F+/C+) than those who were negative according 
to the Canada criteria (F+/C-). However, the other 
study 33 suggested a higher incidence of mental and cog- 
nitive problems among Fukuda-positive patients who 
were also Canada positive (F+/C+) as compared with 
the remaining Fukuda-positive but Canada-negative 
patients (F+/C— ). In a separate publication, 53 the same 
Fukuda-positive patients as referred in Jason et at 3 were 
used to contrast ICC-2011. About 34% (95% CI 26% to 
44%) of the Fukuda-positive patients were also ICC posi- 
tives (F+/ICC+). Similar to the (F+/C+) subset, it was 
found that (F+/ICC+) patients experienced more func- 
tional impairments as well as more mental and cognitive 
problems and higher psychiatric comorbidity than 
(F+/ICC-) patients. 

The comparisons presented in table 3 are associated 
with high risk of bias as well as random errors, and the 
results should be interpreted with great caution. For 
example, two of the included studies reported similar 
point prevalence according to CDC-1994/Fukuda (2.1% 
and 2.6%) but reported very different estimates using 
the Australian-1990 criteria (7.6% and 1.4%). 54 55 
Sometimes diagnoses were based on questionnaire 
responses only, sometimes following detailed clinical 
interviews and laboratory testing. There were also differ- 
ences in the way similar case definitions were practiced 
in the various studies, for example, some studies applied 
a low threshold for exclusion of cases with psychiatric 
comorbidity, while others did not. 



Indirect comparisons of prevalence estimates 
from several case definitions applied on different 
populations (model C) 

We identified 21 studies (table 4) presenting prevalence 
estimates for CFS/ME (figure 3), in addition to the five 
studies presenting prevalence estimates following the 
application of multiple case definitions (table 2). Based 
on these studies, we extracted 17 independent estimates 
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Table 1 Case definitions for CFS/ME 



Case definitions 
(chronologically) 



Developed from other criteria or 
definitions? 





Vsl 1 M 1 IVJIMO 


Inctiti itirtn anrl pni i nti*\A of f i ret 
ll lolllUllvil l cillU OUUllliy Ul lllol 


loi/ovivjy IxS 


dULflUr 


OUIlUldl 


C^pntprq frjr Di<;pa<;p Oontrol 

1 IICI U IKJl L/IOUUOU 1 IllVyl, 


1 1 06/1 542 


Atlanta, USA 




Royal Free Hospital, London, UK 


6/51 


Rn\/fll Frpp Hn<?nitfll 1 nnrlnn I IK 

1 lUyul 1 ICC 1 I Uo[^Jl Id I , 1 KJ\ \\JKJ\ 1 . kJ \ \ 


55/88 


The Prince Henry Hospital, Little 


230/343 


Bay, Australia 




Raigmore Hospital, Inverness, UK 


14/28 


University of Oxford, Oxford, UK 


476/667 


National Task Force, Bristol, UK 


No records 


Centers for Disease Control, 


1860/3006 


Atlanta, USA 




Brigham and Women's Hospital 


78/138 


Massachusetts, USA 




Medical College of Wisconsin, USA 


8/23 


Royal College of Physicians and 


69/233 


Surgeons of Canada, Canada 




Centers for Disease Control and 


73/154 


Prevention, Atlanta, USA 




DePaul University, Chicago, USA 


5/14 


Centers for Disease Control and 


1/5 


Prevention Atlanta USA 




National Institute for Health and 


No records/23t 


Clinical Excellence, London, UK 




The Nightingale Research 


No records/5 


Foundation, Canada 




Southampton, Hampshire, UK 


2/4 


DePaul University, Illinois, USA 


8/18 


Independent, Canada 


4/16 


DePaul University, Illinois, USA 


1/1 



CDC-1988/Holmes etaF 

ME-1988/Ramsey 42 
London-1990/Dowsett etaF 
Australian-1990 44 

Postviral fatigue 

syndrome-1990 43 

Oxford-1991 40 

London ME-1994/National Task 
Force Guidelines 48 
CDC-1994/Fukuda etaF 

Working case definition-1996 38 

CFS-1998 49 
Canadian-2003 22 

Empirical CDC-2005/Reeves 
etaF 

Empirical-2007 41 

Brighton Collaboration-2007 35 

NICE-2007 Guidelines 46 

The Nightingale Definition 
of ME-2007/Hyde 45 
ECD-2008 34 

Revised Canadian-2010 47 

ICC-2011 23 
ME-2011 33 



CDC-1988 



CDC-1988 



CDC-1994 



CDC-1994 



CDC-1994, Empirical CDC-2005, 
Canadian-2003 
Canadian-2003 
London-1990, ME-1988, The 
Nightingale Definition of ME-2008 



'Searched 23 May 2012. 

tSummary of the NICE Guidelines in: diagnosis and management of chronic fatigue syndrome or myalgic encephalomyelitis 
(or encephalopathy): summary of NICE guidance. BMJ 2007;335:446. 
CFS, chronic fatigue syndrome; ICC, International Consensus Criteria; ME, myalgic encephalomyelitis; ECD, epidemiological CFS/ME 
definition. 



of the prevalence following application of the 
CDC-1994/Fukuda criteria (figure 5). 

Our analysis suggests that the population prevalence 
of CFS/ME according to the CDC-1994/Fukuda case 
definition probably is less than 1% (range 0.1-6.4%; 
median 1%), with higher prevalence among consecutive 
GP attendants than from population studies. Prevalence 
estimates seemed higher when patients were diagnosed 
without a preceding medical examination. Prevalence 
estimates of CFS/ME according to CDC-1988/Holmes 
case definition seemed lower, with all the studies report- 
ing prevalence estimates ranging from 0.0% to 0.3% 
(median 0.05%). 

Five studies 54-58 reported CFS/ME prevalence esti- 
mates according to the Oxford-1991 case definition. 



These estimates ranged from 0.4% to 3.7% (median 
1.5%). Four studies 44 54-56 reported prevalence estimates 
according to the Australian-1990 case definition ranging 
from 0.04% to 7.6% (median 1.2%). 

DISCUSSION 

We identified 20 studies presenting different CFS/ME 
case definitions, and 38 studies with data providing 
access to comparison and evaluation of some of these. 
Only a minority of existing case definitions had been 
submitted to comparative evaluations. The validation 
studies were methodologically weak and heterogeneous, 
making it questionable to compare the case definitions. 
The most cited case definition (CDC-1994/Fukuda 
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Table 2 Studies presenting prevalence estimates* by independent application of several case definitions on the same 
population (model A) 


First author, year, country 


Data collection 


Prevalence (95% CI) (%) 


Nacul, 50 2011, UK 
Bates, 56 1993, USA 

Kawakami, 57 1998, Japan 
Lindal, 55 2002, Iceland 

Wessely, 54 68 1 997, UK 


609 possible cases electronically identified in databases 
of 29 GP practices. 70 excluded after clinical revision 
(explained fatigue), 135 refusals and 126 non-cases 
995 consecutive GP visitors invited — 94% screened by a 
questionnaire to detect major fatigue. Selected patients 
further evaluated by questionnaires, physical 
examinations and interviews 

All adults (n=508) in Town A, Kofu-city, were invited to 
participate in this structured psychiatric diagnostic 
interview survey. 137 (27%) completed the study 
Survey sent to 4000 randomly selected adult participants 
— 63% responded. Questionnaire included questions on 
all items in the four case definitions. Diagnoses were set 
electronically based on received responses. No medical 
tests or examinations were undertaken 
2363 patients followed in a cohort study— 84% 
completed. Fatigued participant subjected to detailed 
questionnaires, interviews and laboratory testing. 
Separate estimates reported for inclusion/exclusion of 
psychiatric comorbidity 


ECD: 0.03 (0.02 to 0.04) 
Canada: 0.10(0.09 to 0.12) 
Fukuda: 0.19 (0.17 to 0.21) 
Holmes: 0.3 (0.1 to 0.9) 
Oxford: 0.4 (0.1 to 1.1) 
Australia: 1.1 (0.5 to 2.0) 

Holmes: 0.0 (0.0 to 2.7) 
Fukuda: 1.5 (0.2 to 5.2) 
Oxford: 1 .5 (0.2 to 5.2) 
Holmes 0.0 (0.0 to 1.5) 
Fukuda: 2.1 (1.6 to 2.8) 

UXTOru. o.( \o.iL TO 4.o) 

Australia: 7.6 (6.6 to 8.7) 

Holmes: 1.2 (0.5 to 1.8) 
Australia: 1.4 (0.8 to 2.0) 
Oxford: 2.2 (1.4 to 3.0) 
Fukuda: 2.6 (1.7 to 3.4) 


*Prevalence estimates were calculated with the number of responders in the denominator. The choice of denominator may have large 
implications with regard to the subsequent prevalence estimate, particularly in studies with low response rate. Hence, depending on the actual 
response rate, estimates presented for each study may be biased. 



et aP 9 ) is also the most extensively validated one, 
whereas validation studies are few (Canadian-2003, 22 
ICC-2011 23 ) or missing (National Institute for Health 
and Care Excellence (NICE)-2007 46 ) for recently pre- 
sented and debated case definitions. We found no 
empirical evidence supporting the hypothesis that some 
case definitions more specifically identify patients with a 
neuroimmunological condition. 

Strengths and weaknesses of our study 

The main strength of our study is the systematic 
methods used to identify and appraise articles present- 
ing case definitions of CFS/ME and studies potentially 
useful to evaluate the case definitions. Furthermore, we 
have used systematic and transparent approaches to 
extract data from the validation studies, categorise the 
studies according to three different models and to 
analyse and compare the data. 

The STARD initiative aims to improve the reporting 
on studies of diagnostic accuracy, considering any 
method for obtaining additional information on a 
patient's health status as a test. 25 Owing to the lack of a 
reference standard, we found this guideline less suitable 
for review of articles evaluating case definitions for CFS/ 
ME. Still, issues such as study populations, test methods 
and rationale, technical specifications for application of 
the test, statistical methods for comparing measures of 
accuracy and uncertainty, estimates of diagnostic accur- 
acy, variability and clinical applicability 25 are relevant 
also for our analysis. 



The validation studies we identified were small with 
considerable methodological weaknesses and inconsist- 
ent results. Only one study held a level of rigour where 
independent application of several case definitions was 
conducted on the same population (model A). 50 Such a 
study should ideally be based on a population sample 
rather than a GP practice database, and should compare 
a selection of currently applied and debated case 
definitions, such as CDC- 1994/ Fukuda, Oxford-1991, 
Canadian-2003 and NICE-2007. 

The QUADAS criteria 28 demonstrate that model B is 
an evaluation strategy prone to several sources of bias. 
First, the spectrum of patients subjected to the compara- 
tor is selected and not representative of the population 
receiving the test if it is used alone. Second, as compara- 
tors were mostly applied subsequently to the evaluation 
standard, the clinical evaluations were not independent. 
The estimates from two of the Jason studies 33 52 suggest a 
comparable correspondence (40-70% of the F+ are also 
C+) with the results presented by Nacul et al. 50 Yet, model 
B gives no or limited information regarding those who 
screened negative in the first place. We do not know 
whether some of those might have had a positive diagno- 
sis if screened with one of the other case definitions. 

We are even more prone to bias when exploring the 
consistency of different case definitions through indirect 
comparisons of prevalence estimates obtained from dif- 
ferent populations (model C), and great caution is 
needed when such proxy comparisons are undertaken. 
For example, two of the included studies reported 
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Table 3 Conformity of prevalence estimates in studies where patients diagnosed with CFS/ME with one set of diagnostic criteria are diagnosed sequentially with other 
case definitions (model B) 



Study recruitment 


Case definitions 


Conformity* (95% CI) 


Symptom and burden profile 


Brimacombe et al, 69 USA 


rUKUuaj {n— £.\J\J) 


1 


(r+/n— ; paTienTS ao noT enaorse inTecTious-Type sympToms as onen or to 


Fukuda-positive from register 


noimes \T\=\ i\) 


U.oO (U.oU TO u.yuj 


the same degree of severity as (F+/H+) patients 


hcnn at 0/ 70 1 iQA 

jason er 31, uoa 


rUKUuaj (n=o^:j 


-1 
1 


(r+/n+j paTienTS wiTn more sympToms ana TuncTionai impairmenT Tnan 


rUKuoa-posiTive Trom register 


1 1 /^V 1 KYI /**\ O / K"\ H /I \ 

noimes (n=i4j 


n aa (C\ oft tr» n £Q\ 
U.44 (U.^iD TO U.D^ij 


(r+/n— j. no ainerence in psycnoiogicai comoroiaiTy 


| ocnn 0/ 52 1 IQA 

jason er 31, uoa 


rUKUuaj (n=o^:j 


1 


L/+ paTienTS nave less psycniauic comoroiaiTy, more pnysicai TuncTion 


ruKuaa-posiiive Trom register 


uanaua {r\—^.o)+ 


U.DO (U.44 TO U./yj 


impairmenT, are more TaTiguea wiTn more neurological sympToms Tnan 


I _ _ _ ^_ _x _ / 33 1 I O A 

Jason er 31, UoA 






(r+/u— j paTienTS 


hukudat (n=l 13) 


1 


(F+/C+) patients had more functional impairments, and physical, mental 


Fukuda-positive recruited from 


Canada (n=57) 


U.bU (U.41 TO U.bU) 


and cognitive problems than (F+/C— ) patients. (F+/ME+) patients had 


many sources 


Mb-^01 1 (n=^7) 


0.^4 (0.1b to 0.33) 


more functional impairments, and more severe physical and cognitive 








symptoms than (F+/ME— ) patients 


/9 m 

Flugeefa/, Norway 


ruKuaaj (n=ouj 




Not reported 


Fukuda-positive patients 


Canada (n=28) 


0.93 (0.78 to 0.99) 




recruited to trial 








jason er 31, uoa 


rUKUaaj (n=^:4J 


Of 24 F+ and 84 F-patients empirical 


Canadia-2003 case definition appears to select more cardinal and central 


rtegisier 


neeves empirical 


criTena ana uanaaa luenTiTieu /y ana 


TeaTures ot Tne inness Tnan tmpincai uuLf-^uuiD/ neeves case aeTiniTion 




Canada 


87% correctly 




Jason efa/, 65 USA 


Fukudat (n=27) 


1 


Empirical CDC-2005/Reeves case definition led to misclassification of 


negisier 


neeves emp. 

/ r >_ /I H \C 


1 .UU (U.o/ TO \ .\J\J) 


major aepressive aisoraer as uro 


brown er 31, uoa 


ruKuaaj (n=iioj 


H 

1 


ICC+ patients with more functional impairments and physical, mental and 


rUKuaa-posmve recruiieu Trom 


100 (n=oyj 


U.oJD (U.^iD TO U.44j 


cogniTive prouiems Tnan (r+/iL/L'— ) paTienTS. i ne iuuh- paTienTS aiso naa 


many sources 






greater rates of psychiatric comorbidity 


jason er 31, uoa 


P, ,Lr, .Ho+ /r>— QO\ 

ruKuaaj (n=o^j 


\ 


D+ patients appear to be more symptomatic than (F+/D— ) patients, 


Fukuda-positive from register 


uowseu (n=i / )^\ 


C\ AA (C\ Oft +r» n ftO\ 
U.44 (U.^iD TO U.D^ij 


especially in the neurological and neuropsychiatric areas 


White era/, UK 


Oxford t (n=o41 ) 


1 


Effect of CBT and GET similar regardless of diagnostic group affiliation 


uxTora-posiTive patients 


rUKuaa (n=4^/j 


n ftT ftQ \r\ n vn\ 

U.D/ (U.DO TO U./Uj 




recruited to trial 


London ME 


U.Ol (U.4/ TO U.OOj 




Wpprrlpn at a I 73 1 IK 
VVccUUfciH C7t a/, Ur\ 


/i^ oon\ 

(n=o^y) 








1 


INUI IcpUllfcJU 


Oxford-positive patients 


London ME 


0.31 (0.26 to 0.37) 




recruited to trial 


(n=92) 






Stubhaug et 3I, 74 Norway 


Neurastheniat 


1 


Not reported 


Neurasthenia-positive patients 


(n=72) 


0.90 (0.81 to 0.96), 0.40 (0.29 to 0.53) 




recruited to trial 


Oxford (n=65) 








Fukuda (n=29) 







*The proportion of cases relative to the evaluation standard, 
t Evaluation standard. 

:|:Three of the 23 participants who tested positive according to the Canada criteria were negative according to Fukuda. 

§14 of the 37 patients who tested positive according to Reeves were negative according to Fukuda (these 14 patients had a depression diagnosis). 
HThree of the 17 participants who tested positive according to Dowsett were negative according to Fukuda. 

CBT, cognitive behavorial therapy; CFS, chronic fatigue syndrome; GET, graded exercise therapy; ICC, International Consensus Criteria; ME, myalgic encephalomyelitis. 
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Table 4 Studies presenting prevalence estimates for CFS/ME from several case definitions applied on different populations 
(model C) 



First author, year, country 



Case definition 



Recruitment strategy 



Bazelmans, 1999, 75 The Netherlands 
Lloyd, 1990, 44 Australia 
Buchwald, 1995, 76 USA 
Gunn, 1993, 77 USA 



Price, 1992, 78 USA 
Versluis, 1997, 79 Netherlands 
Bierl, 2004, 80 USA 
Cho, 2009, 81 UK 
Cho, 2009, 81 Brazil 
Evengard, 2005, 82 Sweden 
Hamagucchi, 201 1 , 83 Japan 
Jason, 1999, 84 USA 
Kim, 2005 85 South Korea 



- 86 



Nigeria 
64 USA 



' 37 USA 
1 USA 



Njoku, 2007,* 
Reeves, 2007, c 
Reyes, 2003, 
Steele, 1998, 
van't Leven, 2009 89 The Netherlands 
Vincent, 201 2, 90 USA 

Yiu, 2005 91 China 
Lawrie, 1995, 58 UK 
Ho-Yen, 1991, 92 UK 



As recognized by GP 
Australian 
CDC-1988/Holmes 
CDC-1988/Holmes 

CDC-1988/Holmes 

CDC-1988/Holmes 

CDC-1994/Fukuda 

CDC-1994/Fukuda 

CDC-1994/Fukuda 

CDC-1994/Fukuda 

CDC-1994/Fukuda 

CDC-1994/Fukuda 

CDC-1994/Fukuda 

CDC-1994/Fukuda 

CDC-1994/empirical 

CDC-1994/Fukuda 

CDC-1994/Fukuda 

CDC-1994/Fukuda 

CDC-1994/Fukuda 

CDC-1994/Fukuda 
Oxford 

Post viral exhaustion 
syndrome 



Questionnaire to all GPs, prevalence estimated to 0.1 1% 
Recruited through GP's covering 76 206 patients 
Postal survey to 4000 randomly selected participants 
Recruited by contact with primary health care providers; 
prevalence in the range 0.002-0.007% 
Interview survey with 13 538 participants 
23 000 patients in GP database 
Random digit-dialling survey with 7317 respondent 
2530 consecutive GP visitors 
3921 consecutive GP visitors 
Phone survey of 41 499 participants in a twin register 
3000 random participants in a health check programme 
Phone survey with 18 675 respondents 
1962 consecutive GP visitors 
Interview survey with 1500 participants 
Phone survey with 10 837 responding households 
Phone survey with 33 997 responding households 
Phone survey with 8004 responding households 
Postal survey to 22 500 randomly selected participants 
Retrospective medical record review in Olmsted County; 
183 841 residents 
Unknown 

Postal survey to 1039 randomly selected participants 
Postal survey to 195 GPs; prevalence 0.13% 
(0.12% to 0.15%) 



CFS, chronic fatigue syndrome; GP, general practitioner; ME, myalgic encephalomyelitis. 



similar point prevalence according to CDC-1994/ 
Fukuda (2.1% and 2.6%), but reported very different 
estimates following the application of the 
Australian-1990 criteria (7.6% and 1.4%). 54 55 This 
inconsistency can be explained by major methodological 
differences seen across the included studies. Our sample 
includes studies in which a diagnosis of CFS/ME is 
made on the basis of either questionnaire responses or 
clinical interview Previous studies suggest that patients 
who receive a standardised questionnaire report consid- 
erably more symptoms than when asked to report their 
symptoms spontaneously. 59 There are several other 
sources to this between study heterogeneity such as 
recruitment strategy response rate and strategies for 
non-response adjustment. We were not able to identify 
the most important one. However, Johnston et af 1 per- 
formed an interesting subgroup analysis in their 
meta-analysis of 14 studies applying the CDC-1994/ 
Fukuda case definition, and found that the pooled 
prevalence for self-reporting assessment was 3.28% (95% 
CI 2.24% to 4.33%) compared with 0.76% (95% CI 
0.23% to 1.29%) for clinical assessment. Prevalence was 
lower in community samples (0.87%; 0.32% to 1.42%) 
than in primary care samples (1.72%; 1.40% to 2.04%). 
The prevalence estimates based on self-reports showed 
high variability, while clinically assessed estimates were 
more consistent, especially in the community samples. 



The utility of case definitions and diagnoses 

The utility of a diagnosis is linked to the potential 
effects of being diagnosed (eg, benefits and harms of 
the patient's role, access to treatment and insurance). 
More importantly, a diagnosis is useful if it is linked to 
valid information regarding prognosis or outcomes of 
therapy. Reitsma et af 6 suggest clinical test validation as 
an alternative paradigm for evaluation of a diagnostic 
test when an acceptable reference standard is missing. 
Hence, primary studies and systematic reviews on prog- 
nosis and therapy are alternative sources to evaluate the 
usefulness of different case definitions of CFS/ME. We 
have identified only one such publication, the PACE 
trial. 60 Here, participants were diagnosed according to 
the Oxford-1991 criteria, Empirical criteria-2007/Reeves 
and London ME-1994/National Task Force criteria, and 
then randomised to either standard medical treatment, 
graded exercise therapy, cognitive behaviour therapy or 
pacing. The results showed that the effectiveness of the 
treatments was similar across groups, irrespective of the 
case definition which had been used. Fluge et af 
applied the CDC- 1994/ Fukuda and retrospectively 
added the Canada criteria in their study on the effects 
of rituximab in CFS with comparable results. In a recent 
publication, Maes et af 1 measured symptom severity, 
selected biomarkers and postexertional malaise in 144 
patients with CF, of whom 107 fulfilled the CDC-1994/ 
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Figure 5 Forest plot 
summarising indirect comparisons 
of prevalence estimates from 
different case definitions 
(model C). Studies presenting 
point prevalence weighted for 
non-response are asterisked (*). 
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Fukuda criteria of CFS/ME. They claimed that CF, CFS 
and ME are distinct categories, although stating that 
patients group together in one continuum with no clear 
boundaries between them. 21 Such studies would be even 
more useful if outcomes of specific treatment modes 
had also been tested. 

A study comparing the prognosis of different diagnos- 
tic labels of fatigue found that patients with ME had the 
worst prognosis while patients with postviral fatigue 



syndrome had the best. This could mean that the 
patients destined to the worst prognosis were labelled 
with the ME diagnosis, or it might be explained as an 
adverse effect of being labelled with ME. The authors 
found no significant difference in recorded fatigue 
before the diagnosis of CFS and ME, and the data in 
this retrospective study supported the hypothesis of the 
labelling effect. Another study found that patients who 
attributed their fatigue to ME were more fatigued and 
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more handicapped in relation to home, work, social and 
private leisure activities than patients who attributed 
their fatigue to psychological or social factors. 62 

Broad or narrow case definitions? 

Ideally, correspondence validity between test and target 
should be 100% for sensitivity (the capacity to identify 
patients in the target group) and specificity (the capacity 
to rule out patients who do not belong to the target 
group). More often, there is a trade-off between these 
measures, depending on the purpose of diagnosis. 
Emphasising sensitivity implies a risk of overdiagnosis, 
which dilutes the actual diagnostic concept, while 
emphasising specificity implies a risk of underdiagnosis, 
dismissing patients who might benefit from treatment. 
Development of more exclusive case definitions for 
CFS/ME has been proposed, claiming that existing case 
definitions do not select homogenous sets of patients. 23 
More specifically, Oxford-1991, Fukuda-1994 and 
NICE-2007 have been criticised, especially by patient 
organisations, for undue overlap with psychopathology. 
Proponents of recent case definitions, such as 
Canada-2003 and ICC-2011, claim to achieve a narrow 
selection of patients with ME conforming to a hypothe- 
sised specific pathophysiology. Our review demonstrates, 
however, that these case definitions do not necessarily 
exclude patients with psychopathology. 

A lesson could be learnt from Reeves, who tried to 
elaborate the CDC1994/Fukuda definition and bring 
methodological rigour into the diagnostic criteria by 
scores from standardised and validated instruments. 63 
The Empirical-2006/Reeves case definition led to a 
tenfold prevalence estimate as compared with the 
CDC1994/Fukuda definition, 64 probably due to mis- 
classification and inclusion of patients with major 
depressive disorder. 65 The purpose of rigour had not 
been achieved, and the Empirical-2006/Reeves case def- 
inition was never broadly implemented. According to 
our review, it is uncertain whether a more homogenous 
subset of patients can be achieved with the Canada-2003 
and ICC-2011 case definitions. The authors of the latter 
paper write: "Collectively, members have approximately 
400 years of both clinical and teaching experience, 
authored hundreds of peer-reviewed publications, diag- 
nosed or treated approximately 50 000 patients with ME 
and several members coauthored previous criteria." 23 
This declaration is no validity criterion and provides no 
guarantee that the case definition works according to 
the intentions. 

Case definitions for research or clinical practice? 

Research requires uniform and reproducible criteria, 
suitable for unambiguous definitions of the target popu- 
lation. Another concern is to compare studies across time 
and nations. These are arguments for an inclusive case 
definition, preferably one which has been in use for a 
while, and for which validation studies are available. In 
CFS/ME research, the Oxford-1991 and CDC-1994/ 



Fukuda are the most frequently used case definitions. 
Our review indicates that the former might be more 
inclusive, with lower specificity than the latter, although 
the impact of this is unclear. Proponents for more 
restrictive case definitions dismiss findings from treat- 
ment studies documenting effects of cognitive behav- 
ioural treatment or graded exercise therapy for patients 
diagnosed with the Oxford-1991 or CDC-1994/Fukuda 
case definitions. 66 Their claim is that for a more exclusive 
selection of patients with ME, defined according to spe- 
cific hypothesised pathophysiology, the side effects of 
these treatment modalities are hazardous. So far, 
however, treatment studies based on the Canada-2003 or 
ICC-2011 case definitions are not available. 

Case definitions for clinical practice should be research 
based, validated and manageable to provide a tool which 
can relieve patient's uncertainty, indicate the most 
appropriate treatment and prevent adverse effects and 
waste of healthcare resources of unnecessary treatment 
and diagnostic procedures. 67 They should be founded 
on available knowledge regarding the mechanisms of 
the actual condition, validated through credible and 
transparent processes and presented in a format which 
can be implemented in everyday practice. An argument 
for more inclusive case definitions for CFS/ME would 
be the issue of treatment, since existing evidence indi- 
cates that side effects of cognitive behavioural treatment 
or graded exercise therapy are negligible. For this 
context, the CDC-1994/Fukuda case definition appears 
suitable, with the NICE-2007 as a good candidate for val- 
idation studies. 

IMPLICATIONS FOR RESEARCH AND CLINICAL PRACTICE 

On the basis of our review, we argue that development of 
further case definitions of CFS/ME should be given low 
priority, as long as causal explanations for the disease are 
limited. It might still be useful to classify patients accord- 
ing to severity and symptom patterns, aiming to identify 
characteristics of patients that might predict differences 
in prognosis or expected effects of therapy. 

It is likely that all CFS/ME case definitions capture 
conditions with different or multifactorial pathogenesis 
and varying prognosis. The futile dichotomy of 'organic' 
versus 'psychic' disorder should be abandoned. Most 
medical disorders have a complex aetiology. 
Psychological treatments are often helpful also for clear- 
cut somatic disorders. Unfortunately, patient groups and 
researchers with vested interests in the belief that ME is 
a distinct somatic disease seem unwilling to leave the 
position that ME is an organic disease only. This position 
has damaged the research and practice for patients suf- 
fering from CFS/ME. 

CONCLUSIONS 

Our review provided no evidence that any of the case 
definitions identify patients with specific or 'organic 
only' disease aetiology. Priority should be given to 
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further development and testing of promising treatment 
options for patients with CFS/ME. Classification of 
patients according to severity and symptom patterns, 
aiming to identify characteristics of patients that might 
predict differences in prognosis or expected effects of 
therapy might be useful. Development of further case 
definitions of CFS/ME should be given low priority. 
Consistency in research can be achieved by application 
of diagnostic criteria which have been systematically eval- 
uated and compared with other case definitions. 
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